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Abstract — The recently proposed modified-compressive sens- 
ing (modified-CS), which utilizes the partially known support 
as prior knowledge, significantly improves the performance of 
recovering sparse signals. However, modifled-CS depends heavily 
on the reliability of the known support. An important problem, 
which must be studied further, is the recoverability of modified- 
CS when the known support contains a number of errors. In 
this letter, we analyze the recoverability of modified-CS in a 
stochastic framework. A sufficient and necessary condition is 
established for exact recovery of a sparse signal. Utilizing this 
condition, the recovery probability that reflects the recoverability 
of modified-CS can be computed explicitly for a sparse signal with 
I nonzero entries, even though the known support exists some 
errors. Simulation experiments have been carried out to validate 
our theoretical results. 

Index Terms — Compressive sensing, ^i-norm, recoverability, 
support, probability. 

L Introduction 

Compressive Sensing (CS) allows exact recovery of a sparse 
signal using only a limited number of random measurements. 
A central problem in CS is the following: given an m x n 
matrix A (to < n), and a measurement vector y = Ax*, 
recover x*. To deal with this problem, the most extensively 
studied recovery method is the ^i-minimization approach 
(Basis Pursuit) lUl-Q 

min||x|L s.t y = Ax (1) 

X 

This convex problem can be solved efficiently; moreover, 
0{£\og{n/£)) probabilistic measurements are sufficient for it 
to recover a ^-sparse vector x* (i.e., all but at most £ entries 
are zero) exactly. 

Recently, Vaswani and Lu |l6l-||9|, Miosso HO), HI], Wang 
and Yin |12|, |13|, Friedlander et.al |14|, Jacques fT5\ have 
shown that exact recovery based on fewer measurements than 
those needed for the -minimization approach is possible 
when the support of x* is partially known. The recovery is 
implemented by solving the optimization problem. 

min||xjc||j^ s.t y = Ax (2) 

where T denotes the "known" part of support, T'' = [1. n] \ 
T, Xrpc is a column vector composed of the entries of x with 
their indices being in T*^. This method is named modified- 
CS 16] or truncated £i minimization 112|. One application 
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of the modified-CS is the recovery of (time) sequences of 
sparse signals, such as dynamic magnetic resonance imaging 
(MRI) (H], 19]. Since the support evolve slowly over time, the 
previously recovered support can be used as known part for 
later reconstruction. 

As an important performance index of modified-CS, its 
recoverability, i.e., when is the solution of Q equal to x*, has 
been discussed in several papers. In |6J, a sufficient condition 
on the recoverability was obtained based on restricted isometry 
property. From the view of f-null space property, another 
sufficient condition to recover ^-sparse vectors was proposed 
in lfl2l . However, there always exist some signals that do not 
satisfy these conditions but still can be recovered. Specifically, 
in real-world applications, the known support often contains 
some errors. The existing sufficient conditions can not reflect 
accurately the recoverability of modified-CS in many cases. 
Therefore, it is necessary to develop alternative techniques for 
analyzing the recoverability of modified-CS. 

In this letter, a sufficient and necessary condition (SNC) 
on the recoverability of modified-CS is derived. Then, we 
discuss the recoverability of modified-CS in a probabilistic 
way. The main advantage of our work is that, for a randomly 
given vector x* with £ nonzero entries, the exact recovery 
percentage of modified-CS can be computed explicitly under 
a given matrix A and a randomly given T that satisfied |T| = p 
but includes pi errors, where |T| denotes the size of the 
known support T. Hence, this paper provides a quantitative 
index to measure the reliability of modified-CS in real-world 
applications. Simulation experiments validate our results. 

II. Probability Estimation On Recoverability of 

MODIFIED-CS 

In this section, a SNC on the recoverabiUty of modified-CS 
is derived. Based on this condition, we discuss the estimation 
of the probability that the vector x* can be recovered by 
modified-CS. We name this probability as recovery probability. 

A. A Sufficient and Necessary Condition for Exact Recovery 
Firstly, some notations are given in the follows. The support 
of X* = (a;|, x* )^ is denoted by N, i.e. N ^ {jl^j 7^ 0}. 
Suppose N can be spUt asN = TUA\Ae, where A = N \ T 
is the unknown part of the support and Ae = T \ N is set of 
errors in the known part support T. The set operations U and 
\ stand for set union and set except respectively. 

Let x'^) denote the solution of the model dU and F denote 
the set of all subsets of A. A SNC is given in the following 
theorem, which is an extension of a result in |T6] . 
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Theorem 1: For a given vector x*, x*^^^ = x*, if and only 
if VI G F, the optimal value of the objective function of the 
following optimization problem is greater than zero, provided 
that this optimization problem is solvable: 



min > 
s ^ 

feGCT-'VI) 



41 - ^ 14 1, s-i- 



feel 



= 0, ll^lli = 1 
4a;fc > for k el 
Skxl < forke A\I 



(3) 



where S = (4, -,4)^ e R". 

The proof of this theorem is given in Appendix I. 

Remark 1: For a given measurement matrix A, the recover- 
ability of the sparse vector x* based on the model (|2|i depends 
only on the index set of nonzeros of x* in T"^ and the signs of 
these nonzeros. In other words, the recoverability relies only 
on the sign pattern of x* in T*^ instead of the magnitudes of 
these nonzeros. 

Remark 2: It follows from the proof of Theorem 1 that, 
even if T contains several errors. Theorem [T] still holds. 



B. Probability Estimation for Recoverability of the Modified- 
CS 

In this subsection, we utilize Theorem 1 to estimate the 
recovery probability, i.e., the conditional probability P(x(^^ = 
X*; l|x*||o = i, |T| = p, |Ae| =pi,A), where l|x*||o is defined 
as the number of nonzero entries of x*, |T| and |Ae| denote 
the size of T and Ag respectively. Let G denote the index set 
{1, 2, n}, it is easy to know that there are Cf^{— ^i^,"!^)! ) 
index subsets of G with size £. We denote these subsets as 



J 



1,...,C^. For each G^ \ there are C^^ subsets with 
size p2 = {p — Pi)- We denote these subsets as N^^^-*, s ~ 
1, Cf^. At the same time, for the set G\N (the index set of 
the zero entries of x*), there are C^i^ subsets with size pi. 
These subsets are denoted as H^^^"*, i — 1, C,^^_^. Without 
loss of generality, we have the following assumption. 

Assumption 1: The index set N of the i nonzero entries 



of X* can be one of the Ci index sets G^^-*, j — 1, ...,C,^, 



the modified-CS. Hence, following Assumption 1, the recovery 
probability is calculated by 



P(x(i) - x*;||x*||o = I, |T| = p, I Ael = PI, A) 



-y—y — 



(4) 



where £ = 1, m, p = 0, ...,£, pi = 0, ...,p and p2 = p — pi- 
Because the measurement matrix A is known, we can 
determine - in (|4|i by checking whether the SNC (|3]l is 
satisfied for all the 2^^p^ sign column vectors corresponding 



to the index set G 



K^/'^ andN'/^) 



Now we present a sim- 



with equal probability. The index set Ae of pi errors in 
known support can be one of the C^^^ index sets H^f'K 
i — 1, ■■■,C^_^, with equal probability. The index set T\Ae 
of p2 nonzero entries can be one of the C^^ index sets N^''^-', 
s = 1, C^^ , with equal probability. All the nonzero entries 
of the vector x* take either positive or negative sign with equal 
probability. 

For a given vector x* and the known support T, there is 
a sign column vector t = sign{ii^o) E R"^'' in T'^. The 
recoverability of the vector x* only relates with the sign 
column vector t (see Remark 1). Under the conditions that 
the index set of the nonzero entries of x* is G^ and the 
known support is N^^*^^ U H^^^'^ then there are 2^^^^ sign P(x(^^ = x*; 



ulation example to demonstrate the validity of the probability 
estimation by (|4]i through comparing it with simulation results. 

Example 1: Suppose A e R^^^ was taken according to 
the uniform distribution in [-0.5, 0.5]. All nonzero entries of 
the sparse vector x* were drawn from a uniform distribution 
valued in the range [-1, +1]. Without loss of generality, we 
set p — 2. For a vector x* with £ nonzero entries, where 
£=2, 3, 7, we calculated the recovery probabilities by (|4]l, 
where pi = 0,1,2 respectively. For every £ {£ = 2,..., 7) 
nonzero entries, we also sampled 1000 vectors with random 
indices. For each vector, we solved the modified-CS with 
a randomly given T, whose size equals to p but contains 
pi errors, and checked whether the solution is equal to the 
true vector. Suppose that nf, vectors can be recovered, we 

calculated the ratio p^ — as the recovery probability 

P(x(i) = x*;l|x*|io = £AT\ = P,|A,| = pi,A). The 
experimental results are presented in Fig. [T] Therein, solid 
curves denote the theoretic recovery probability estimated by 
dUi. Dotted curves denote probabilities P{x^^^ = x*; ||x*||o = 
£, |T| = p, |Ae| = pi, A). Experimental results show that the 
theoretical estimates fit the simulated values very well. 

However, the computational burden to calculate ^ 
increases exponentially as the problem dimensions in- 
crease. As mentioned above, for each sign column vec- 
tor and the corresponding index sets, we denote the quads 
[Gf ,N^),H^\t.], where j = l,...,Ci, s = , 
i = 1,...,CP^_^ and r = 1,...,2^-P2. Suppose Z is a 
set composed by all the quads, there are C^C^^ Cf^^_g2^~P^ 
elements in Z. For each element of Z, if the sign column 
vector tr can be recovered by the modified-CS with a given 
matrix A and a known support T — N^^^-* U h|^^^, we 
call the quad can be recovered. In dUi, the estimation of 
recover probability need to check the total number of quads 
in Z. Hence, when n increases, the computational burden will 
increase exponentially. To avoid this problem, we state the 
following Theorem. 

Theorem 2: Suppose that M quads are randomly taken 
from set Z, where M is a large positive integer (M <C 
CfjCf C^i^2^-P^), and K of the M quads can be recovered 
by solving modified-CS. Then 



column vectors. Among these sign column vectors, suppose 

that wi. j sign column vectors can be recovered, then ji^^j 
is the probability of the vector x* being recovered by solving 



^,|T| 



K 



- -H-l -Pj^el =Pl>A) — (5) 

The proof of this theorem is given in Appendix II. 
Remark 3: In real-world applications, by sampling ran- 
domly M sign vectors with £ nonzero entries, we can check 
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Fig. 1 

Comparison of theoretical and simulation results on 
recovery probability. solid curves: probability curves of 

P(x('-) = X*; ||X*||o = = p, I Ae| = Pi, A) OBTAINED BY 

DOTTED CURVES: PROBABILITY CURVES OBTAINED BY A RANDOM 

SAMPLING. The three pairs of solid and dotted curves from the 

TOP TO THE BOTTOM CORRESPOND TO|T|=2,|Ac|=0, 1,2 
RESPECTIVELY. 



Fig. 2 

Probabilities curves obtained in example 2. The horizontal 
axis represents the sampling numbers. the vertical axis 
represents the probabilities 

P(x(l) = X*; ||X*||o = £, |T| = p, |Ae| = Pi, A) OBTAINED BY ((SJ-THE 
THREE CURVES FROM THE TOP TO THE BOTTOM CORRESPOND TO 
(m,n,l,p,pi) = (7,9,4,2, 1), (52, 128,20,8,3) AND 
(181, 1280, 60, 32, 4) respectively. 



the number of the vectors that can be exactly recovered by 
modified-CS with a random known support T whose size 
is p but contains pi errors. Suppose K sign vectors can be 
recovered, the recovery probabiHty P(x^^) = x*;||x*||o = 

|T| = p, |Ae| = pi,A) can be computed approximately 
through calculating the ratio of K/M. 

From the proof of Theorem 2, the number of samples M, 
which controls the precision in the approximation of (|5]l, is 
related to the two-point distribution of Vk other than the size 
of Z. Thus, there is no need for M increasing exponentially 
as n increases. In the following example 2, this conclusion as 
well as the conclusion in Theorem are demonstrated. 

Example 2: In this example, according to the uniform 
distribution in [-0.5, 0.5], we randomly generate three matrices 
A, e i?™^" (i = 1,2,3) with (m, n)=(7, 9), (52, 128) and 
(181, 1280) respectively. For matrices Ai, A2 and A3, we set 
(^, p, _pi)=(4, 2, 1), (20, 8, 3) and (60, 32, 4) respectively. As 
n increases in the three cases, the number of sign vectors 
increases exponentially. For example, for {m,n,£,p,pi) = 
(7, 9, 4, 2, 1) and (52, 128, 20, 8, 3), the set Z contains approx- 
imately 2.02 X lO** and 1.24 x 10'^'' elements respectively. 
Hence, for the three cases, we estimate the probabilities 
P(x(i) = x*;||x*||o = e,\T\ = p,\A,\ = pi,A) by ©. 
For each case, we sample Af=100, 500, 1000, 5000, 10000 
respectively. The resultant probability estimates depicted in 
Fig. |2] indicate that 1) the estimation precision of (|5]l is 
stable in our experiments with different number of samples. 
Therefore, we may just need very few samples to obtain the 
satisfied estimation precision in real-world applications; 2) as 



n increases in three cases, the number of samples M don't 
need an exponential increase. 

III. Conclusion 

In this letter we study the recoverability of the modified-CS 
in a stochastic framework. A sufficient and necessary condition 
on the recoverability is presented. Based on this condition, 
the recovery probability of the modified-CS can be estimated 
explicitly. It is worth mentioning that Theorem 1 can be easy 
to extend to the weighted-^i minimization approach that was 
proposed in |17| for nonuniform sparse model. Moreover, the 
recovery probability estimation provides alternative way to 
find (numerically) the optimal set of weights in the weighted- 
£1 minimization approach, which has the largest recovery 
probability to recover the signals. 

Appendix I 
Proof of Theorem 1 

Proof: Necessity: Suppose that x'^^ = x*. Thus x* is 
the optimal solution and ||xj<:||i is the optimal value of the 
optimization problem in (|2|i. 

For a subset I G F, when (O is solvable, there is at least 
a feasible solution. For a feasible solution d of ([3]i, it can be 
proved that x* +t6 is a solution of the constraint equation of 
dU, where t is a constant. In the following, we suppose t < 



4 



(6) 



with sufficiently small absolute value. Then we have 

||x^c+Mtc||i = ^|4 + Mfe|+ J2 \xl + tSk\ + 
kei fceA\i 

= J2\'^i\-\t\J2\^k\+ J2 i^^n 

feel feel feeA\i 

\t\ E i-^^-i + i^i E I'^fci 

feeA\i feeT<:\A 

= Kciii + iti( E i^'^i-Ei'^fci) 

fee(T<=\i) feel 

Since x* is the optimal solution of the optimization problem 
(|2]i, it follows from ^ that 

ii4=iii + N( E i^'«i-Ei'^fci)>K=iii (7) 

feG(T<=\i) feel 

Thus, 

E \^>^\-T.\^k\>o (8) 

fee(T'=\i) feel 

The necessity is proved. 

Sufficiency: Suppose that is a solution of the constraint 
equation in (|2]i, which is different from x*. Then x^ can be 
rewritten as 

(9) 



where S 



, t* 



*-xt||^^0. 



11"* -"till 
Now we define an index set I 

I = {k\k G A, sign{xX) — sign{Sk)}- 
From (|9]l, we have 



(10) 



Wx^c +t*s 



T-lli 



(11) 



feel fceA\i 

E 1^*'^^! 

feeT<^\A 

> E 1^1- 1^*1 Ei'^^i+ E 

feel feel feeA\i 

\t*\ E 1^^1 + 1^*1 E i-^^-i 

fceA\i fceT'^VA 

= iix;c|i, + ri( E I'^fci-Ei'^^-i) 

fee(T<=\i) feel 

It can be easily proved that for the defined index set I in 
([Tol l. I G F and (5 is a feasible solution of (O. From the 
condition of the theorem, we have 

E 141 -Ei'^^i >o- (12) 

fee(T<^\i) feel 
Combining (fTTT i and (fT2] i. we have 



> X 



T'^ 111- 



(13) 



Hence, x* is the optimal solution of (|2]i. Thus, x^^' = x*. 
The sufficiency is proved. ■ 



Appendix II 
Proof of Theorem 2 

Proof: Suppose Z can be split as Z = Zg U Z/, where 
Zg denotes the set composed by the 5^ quads that can be 
recovered, Z/ = Z \ Zg. For a quad C, we have 

Sw 

P(C e Ze) = (ji(jP2(jpi ^2^-P2 '-1^-' 

Now we define a sequence of random variables Vk using the 
set of of quads Ze 



Vk 



(15) 



1, Cfe e Ze 

0, CfeGZ^ 

where k = 1, 2, Cfe is a quad randomly taken from Z. 

From (O, it follows that P{vk = 1) = 
S^/CiCP'CPl,2'-P\ P{vk = 0) = 1 - Pivk = 1). 
Therefore, Vk,k = 1,2,... are independent and identically 
distributed random variables with the expected value 
Eivk) = S^/CiCP'CPl,2'-P\ 

According to the law of large numbers (Bernoulli) in prob- 
ability theory, the sample average {^/M)^^^-^^Vi — K/M 
converges towards the expected value E{vk), where Vi is a 
sample of the random variable Vk- It follows that when M is 
sufficiently large 

Eivk) = S^/Cf,Cf C^L,2^-P^ ^ ^ (16) 



M 



The theorem is proven. 
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